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single parents who recently started a new period of lA, one-half were 
assigned to the program group and were informed that if they remained on lA 
for the next 12 months they would be eligible for the SSP supplement; the 
other half were assigned to the control group. SSP group members were asked 
questions and attended focus-group interviews to verify they understood the 
nature of the SSP supplement offer. Results indicated between one-half and 
three-fourths of them had relatively precise knowledge. The primary focus of 
the experiment was to determine whether some individuals would prolong their 
stay on lA to gain SSP eligibility. Analysis of the delayed exit effect 
suggested it was fairly small, on the order of 3 percentage points, i.e. 3 
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Introduction 

A. important concern in social policy 

shifts in the size and contposrtton of “ ^r„ the ease of welfare, for example, it has 

evaluate the costs and henefits of jornrng the program, hr , Moffitt 

icmg been reeognized that a rise in benefit rates ,nc.e^«^^ ^ 

(1992a) has stressed the potential attractrvraess rttmim features (sueh as the level 

ducements for entering welfare.^ The possibility J behaviour in order to 

of benefits or an offer of subsidized trarmng) ^ ‘“^t p„gtam innovations 

beeome eligible for a program poses a ehdtoge f" If a program 

are evaluated by studying the responses o e ““ “ behavioural effeets and eosts of the in- 
ehange leads to a different partie.pant pool, An evaluation that 

novation may be different from the ones ex . assessment of the program’s overall 

ignores such “entry effects” may then grve an rncomplete assessment p u- 

effects. n ;^„nrtance of entry effects in interpreting 

- 1 . ™ - 

eaveats that apply to inferences denved from sueh “tcth^s- _easure potential entry effeets. All 
We are aware of five studies that use actual data to measme potratrm ^ recipients 

five compare welfare applieation rates in srtes that 1'“'''.^'“!'® ^ .v„„in o ,he effect of 

with application rates in sites that do not have ^ j conclude, as anticipated, that 

a mandmory program on welfare apphcatrons. Two 1996; Phillips, 

mandatory programs make welfare less a^trve affect (Schiller and 

S, (wi. - wm. i»4i I- 

feet on studies is whether differences in welfare applieation rates at dif- 

ferent sZZZ becaL of behavioural responses to the availability of training or for oftrer rea- 

nitude of entry effects for voluntary and ry • would reduce entry onto welfare, whereas a vol- 

naming program with heavy time and ''J'^^„ar effec however, arises from the assumption m his 

nnmty training pmgram would meteare entry. Much of dte ehe« ^ ^ . 

meoretical model that participants will perceive less of a sti^to wmg 
Sng program, and no, from the features of the naming program itself. 

- 1 - 



ERIC 



sons. The studies use fixed-effects regression models with various confrol variables to adjust for 
differences that are not attributable to the program. Whether these adjustaients are adequate is 
inherently problematic. Indeed, the results are often sensitive to changes in model specification, 

suggesting the need to interpret them with caution. 

This paper reports findings fi-om what we believe to be the first randomized evaluation of 
“entry effects” associated with a welfare program innovation.* * The program — known as the 
Self-Sufficiency Project (SSP) — is currently being tested in Canada and offers single 
who have been on income assistance (lA) for a year or more an earnings supplement if they find 
full-time work and leave welfare.* Although SSP does not offer training, the results of the en^ 
effect experiment may have implications for the size of the entry effects associated with other 
welfare program innovations, such as the provision of subsidized training. 

The SSP supplement is generous: Individuals in British Columbia who work at least 30 
hours per week receive one-half of the difference between their gross earnings and a target earn- 
ings level of $37,500 per year.’ For example, an individual who works 30 hours per week at 
$7.50 per hour (roughly the median wage earned by SSP participants) earns $975 per month and 
receives a $1,075 monthly earnings supplement.® Early data show a sizeable take-up rate for the 
supplement offer and significant behavioural responses to the program.® 

The attractiveness of the SSP supplement to the existing pool of long-term lA recipients 
raises the question of whether the availability of the supplement might lead some single parents 
to alter their behaviour in order to become eligible for SSP. Since the supplement is available 
only to individuals who have been on lA for 12 months or more, SSP creates two types of poten- 
tial “entry effects.” Some individuals who otherwise would not be on welfare might decide to 
begin an LA spell — a “new applicant effect”; while some lA recipients who otherwise would 
leave welfare within a year might decide to extend their stay to gain SSP eligibility — a “delayed 
exit” effect. In principle, both types of entry effects may be important. However, because the be- 
havioural changes needed to generate delayed exit effects are probably far less extensive than 
those needed to create new applicant effects (which require people to bear the costs and stigma of 
applying for welfare), it seems likely that delayed exits are a more important source of entry ef- 
fects. For this reason, and because of the large samples and potentially high costs of implement- 
ing an experimental test of new applicant effects,"’ the SSP entry effect experiment is limited to 
the analysis of delayed exit effects. 



'One other experimental evaluation of a welfare program similar to SSP that examined entry effects was the 
Seattle-Denver Income Maintenance Experiment (Keeley et al., 1978). In this study, entry effects took the form of a 
reduction in work effort by persons not initially eligible for benefits from a negative income tox (NIT) program. 

Entry effects for the NIT program were found to be negligible. 

®The SSP supplement is explained in more detail below. See Mijanovich and Long (1995) for further details and 
Card and Robins (1996) for a preliminary evaluation of the supplement’s impact on long-term welfare recipients. 

’All dollar amounts in this paper are Canadian dollars (one Canadian dollar is approximately US$0.75). 

*As discussed in Card and Robins (1996), because of differences in the way LA and SSP benefits are calculated, 
the relative generosity of SSP varies considerably across families and for certain families SSP benefits are not very 

generous relative to I A. . 

’For example, individuals who were offered the supplement had higher employment rates (+12 percentage points), 
higher monthly earnings (+ $137 per month), and lower welfare participation rates (-13 percentage points) than a 
randomly assigned control group (Card and Robins, 1996, Table 3). 

'“To test for a “new applicant” effect would require sampling from the entire population of lone mothers (those at 

(continued) 
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The SSP entry effect experiment uses a classical randomized desip. ^ 

sinale parents who^ently started a new spell of lA, one-half were assigned to 
group and were informed that if they remained on lA for the next 12 
L for the SSP supplement." The other half of the sample were to d^e 

(and were not made the offer). Because assignment was random, any differences in the b 
oTl can be attibuted to the “treatment” of an offer of SSP supptaent eligibjh^ 

Specifically, any increase in the fraction of individuals 

relative to the control group is an estimate of the delayed exit effect induced by the SSP supp 

The remainder of this paper describes the findings of the entry effect ev^^ion. ’• 
with a brief overview of the SSP program and the design of the entry effect expenm»t,^d to 
summarizes some information on the 3,315 individuals participating m the 
section describes our attempts to verify that individuals in the program 

hire ofthe SSP supplement offer. Our main findings on the differences between the beh 

pro™d ^ntrol groups are then presented, followed by a comparison ofthe behaviour of 
rndi”nte prograS A who became eligible for SSP with Jhe be oHn^vitos 
in the main SSP experiment, who were drawn from the existing pool of long-term lA recipients. 
The paper closes with our conclusions. 

The SSP Experiment and the Evaluation of Entry Effects 

Background 

The Self-Sufficiency Project was conceived by an advisory committee of Hum^Re- 
sources Development Canada (the federal department responsible for welfare 
policy) as a rigorous test of the value of financial incentives in encouraging work among loi^- 
term welfare recipients.'' SSP’s graduated earnings supplement is similar to the negative inco 
tax proposals that were evaluated in social experiments in the Umted States and Cmada dunng 
the 1970s (Robins, 1985; Hum and Simpson, 1991). Several 

guish it from a conventional negative income tax, however. Most important, SSP is ava riable 
Ly to single parents who have been on lA for over a year. This restnction was a^pted to re^ 
duce the incentives for individuals to enter lA in order to receive the supplement t^aUs 
reduce entry effects SSP payments are further limited to individuals who leave lA and fin 
to iTTof mire joL to entail 30 or more hours of work per week). Unlike eonventtonal 

family-ineome-based programs, the SSP supplement varies 7* 

fected by family size, nonlabour income sources, or other family members incomes. Fina y. 



risk of becoming welfare recipients). Because so few of these lone mothers would actually respond by applying for 
welfare a large sample would be required to obtain statistically significant effects. 

"FanUlies do not iL eligibility if they become a two-patent “‘’“5"“’ “ ™ ?cp OTeriment 

■'See SRDC ( 1993) and Mijanovich and Long (1995) for mote detatls on the destgn of the SSP experiment. 
•StsTe SSP ancient fotmuta does not penalize single parents who receive child suppotL marry, or find a 
patTer benefits from SSP don’t incr«tse wid. family size, SSP is relatively less genemns than 

lA for larger families. 
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supplement payments are available for up to three years only, and only to individuals who qual- 
ify and begin receiving SSP payments within 12 months of their initial eligibility.^^ 

The overall SSP experiment consists of two experiments: the mam (or recipient ) ex- 
periment and the entry effect experiment that is the focus of this paper. In the recipient expen- 
ment, a group of some 6,000 single parents in British Columbia and New Brunswick wo a 
been on lA for at least a year were randomly divided into program and control groups. The pro- 
gram group was offered the earnings supplement while the control group was simply mterviewe 
^d followed. Initial results from an early cohort of participants in this expenment are descnbed 
in Card and Robins (1996), and indicate a 25 percent SSP take-up rate among the program group 
during the fifth quarter of supplement eligibility.'^ Based on comparisons with the behaviour of 
the control group, about 60 percent of SSP participants are individuals who otherwise would 
have been expected to stay on lA, while 40 percent are individuals who would have been ex- 
pected to leave lA and work full-time anyway. SSP payments among those who took the sup- 
plement in British Columbia averaged $900-$ 1,000 per month, just slightly less than the 
maximum lA grant available to a typical single parent." These findings suggest that the supple- 
ment offer is a valuable benefit for many long-term welfare recipients, and underscore the im- 
portance of considering the possible additional costs associated with entry effects generated by 
the SSP supplement offer. 



The Entry Effect Experiment 

The SSP entry effect experiment is designed to measure the effect oi the future availabil- 
ity of an earnings supplement on the behaviour of newly enrolled lA recipients. As noted earlier, 
behavioural changes among people already on LA represent only one of two possible sources of 
entry effects in response to the SSP supplement offer. Changes in the number and/or types of 
people who begin a new spell of lA may also arise, but are not directly evaluat^ in die expen- 
ment. We return to the question of the likely magnitude of these new applicant effects in the con- 
cluding section of the paper. . l, U A 

The entry effect experiment utilized a random sample of all single parents who had ap- 
plied for and received lA between January 1994 and March 1995 in Vancouver and the sur- 
rounding area of lower mainland British Columbia. By definition, these individuals were 
beginning a new spell of lA, although a significant minority (31 percent) had received lA pay- 
ments at some time in the two years prior to their most recent application. After the lA applica- 
tion was approved and processed, both the British Columbia Ministry of Social Services and 
Statistics Canada (the data collection contractor for the experiment) mailed letters to 4,198 indi- 
viduals informing them that they had been selected to participate in a research project They were 
then contacted at home to complete a baseline interview and were asked to sign an informed con- 
sent form volunteering for the study and granting access to their administrative records. Ap- 



'^Overall, about 34 percent of the program group participated in SSP at some time during the first two years of 

British Columbia program group, average monthly SSP payments among tho^with a posi- 
tive payment were $892 in the twelfth month of the experiment and $957 in the seventeenth month. The maximum 

lA grant for an average family was $ 1 ,079 in British Columbia. 

.'n-echnically, only individuals who did not receive lA benefits during the six months pnor to application were 
deemed eligible for the entry effect experiment. 
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proximately 80 percent (3,368) of individuals selected into the experiment completed the in- 

home baseline interview and signed the consent form.” i a 

As shown in Appendix Table Al, most individuals (70 percent of the sample) had re- 
ceived one lA check before the month of random assignment, although some (less than .5 per- 
cent) had received as many as four checks and others (7 percent) had not yet received ^y. We 
use the month relative to the date of random assignment as a dating convention throughou is 
paper, since this is the month in which the “treatment” was administered. This convention in- 
troduces some ambiguity, however, because different people reach their minimum 12-month stay 
on lA in different months after random assignment — anywhere from 8 to 12 months, d^endmg 
on the number of lA checks received before random assignment. The overall expenment^samp e 
consists of 3,3 1 5 individuals: 1 ,648 in the program group and 1 ,667 in the control group. 

Immediately after the baseline interview, individuals were randomly assigned to either 
the program group or the control group, and received a letter explaining their status — at is, 
whether they had been assigned (randomly) to the program group or to the “overall study group 
(i.e. the control group). The “treatment” received by the program group took the form of a letter 
and brochure informing them of their potential eligibility for SSP and explaimng the natme o 
the supplement offer in more detail.^ In addition, program group members were mml^ a 
“reminder” seven months after their baseline interview. In both the imhal and reniinder le ers, 
the supplement offer was outlined and program group members were instructed Aat SSP can 
provide extra money (an ‘earnings supplement’) to certain people who are on lA ; they were also 
told of the eligibility rules — specifically, the necessity of receiving lA for 12 months m a row. 
The letters included a telephone number to call for more information, and about 10 percent ot the 
program group contacted the Social Research and Demonstration Corporation (SRDC) office for 
clarification of the rules. The brochure was a multi-page leaflet (also used in the recipient ex- 
periment) that explained the eligibility rules and the SSP formula, and provided an example of 

the supplement payment for a typical individual. 

Both program group and control group members were reinterviewed 11 months after re- 
ceiving their first lA check — just prior to the completion of the minimum time that program 

"According to the interviewers, a main reason for nonresponse was that individuals had already left lA by Ae 
time they were contacted for their baseline interview. Among individuals who were still on lA but refused to par- 
Sat .Ita. would ba off lA va,y ,u,oldy (so„« w»a 0 „ lA buoau» they were w.J^g ,0 r.ecMve 

UnLployment Insurance benefits) and were reluctant to take part in an experiment designed for welfce recipients^ 
By excluding these short-termers from the sample, our estimates of delayed exit effects are likely to be overs e 

because none of these individuals would have been likely to respond to the SSP offer. 

•'Throughout this paper, the following convention is used: month 1 refers to the month of random assignment and 

month -1 refers to the previous month. (There is no month 0.) , , i 

•’Originally 3,368 individuals completed a baseline interview, but 53 of them were deleted from the final sample 

because they had not been off lA in the months prior to the month they were recorded ^ ^ 

cause by the time they completed a baseline interview they had already spent two months off lA. Of these mdividu 
als 23 Lre in the program group and 30 were in the control group. The entena used to determme these deletion 
were independent of program-control status, and thus should not lead to any biases m estimated prograni mip^ 
^TTie program assignment letters were mailed from the Social Research and Demonstration ^°^or^on (S^C) 
office, tEe research organization conducting the experiment in Canada. If the letter was returned to a ^de- 

liverable. it was forwarded to the relevant lA caseworker and resent to the last teovm adless on Ae M ^ 
Social Service’s (MSS) lA information system. Only four letters were subsequently returned to the MSS as undeliv- 

erable by the post office. 
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group members would have to spend on lA in order to become eligible for SSP. This survey, 
along with the baseline interview and administrative records on lA recipiency and SSP payments, 
form the primary data sources for evaluating the entry effect experiment. 

Sample Description 

Table 1 presents information on the characteristics of individuals enrolled in the entry ef- 
fect experiment, based on data from the baseline interview and lA records.^' The first column of 
the table shows data for the overall sample, while columns 2 and 3 present data separately for the 
control and program groups. Since program status was randomly assigned, any differences in 
baseline characteristics of the two groups should arise only by chance. T-statistics for tests of 
equality of the mean characteristics of the groups are recorded in column 4. For comparative 
purposes, column 5 of Table 1 presents similar descriptive information for an early cohort of in- 
dividuals enrolled in the SSP recipient experiment, and column 6 contains t-statistics for tests of 
equality between the characteristics of the entry effect and recipient samples.^^ Finally, column 7 
presents data on the population that might be considered “at risk’’ of entering lA and becoming 
eligible for SSP — a sample of lone mothers in the province of British Columbia drawn from the 

1991 Census.^ . . 

Several key features of the population of new welfare applicants and longer-term recipi- 
ents emerge from Table 1. Single-parent lA recipients in British Columbia are overwhelmingly 
female, and tend to be relatively young and poorly educated. The fraction of recent applicants 
with less than a high school education is 41 percent, versus 54 percent among longer-term wel- 
fare recipients in the recipient sample, and 29 percent among all lone mothers in the province. As 
might be expected, new welfare applicants are somewhat less educated than the overall popula- 
tion of single mothers, but better educated than the group of single parents who have been on 
welfare for a year or more. Interestingly, immigrants make up a higher fraction of recent welfare 
applicants (30 percent) than they do of either the population of lone mothers (17 percent) or the 
population of longer-term welfare recipients (23 percent). This suggests that immigrant parents 
have higher rates of both entering and leaving welfare than do nonimmigrants. By comparison, 
the fraction of individuals of First Nation (aboriginal) ancestry in the SSP applicant population is 
less than their fraction in either the long-term recipient sample or the pool of all single mothers, 
suggesting that First Nation parents have lower welfare entry and exit rates than do other groups. 

The family background data in Table 1 indicate that lA applicants and longer-term recipi- 
ents come from relatively disadvantaged families with poorly educated parents, a high rate of 



^'To avoid confusion with the SSP recipient experiment, we sometimes refer to individuals eiuolled in the entry 
effect experiment as “applicants” or “new applicants.” It should be understood that these individuals are new appli- 
cants who acmally begin a spell of welfare. 

^^Note that the main SSP experiment is being conducted at sites in both British Columbia and New Brunswick, 
whereas the entry effect experiment was conducted in British Columbia only. In Table 1 we include only individuals 
in the British Columbia recipient sample. 

^^SSP is available only to single parents with children under age 19, whereas the sample of lone mothers m the 
1991 Census includes women with older children. As a rough adjustment procedure, we constructed weights to 
down-weight the relative fraction of mothers in the census sample whose only child was over age 14. Our weighting 
procedure lowers the relative fraction of such mothers from 37 percent in the unweighted sample to 5.3 percent — 
the acmal fraction of single parents in the SSP applicant sample whose only children are over age 15. 
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Table V Description of Baseline Characteristics of Entry Effect Sample, and Com^risws the 

Table 1. Recipient Sample and British Coliirbia Lone Hothers m the 1991 Census 





Overall 
Entry Effect 
Sample 
(1) 


By Program Status 


RC Reel me 


nt Sample 
T-test vs. 


Lone Mothers 
in BC in 
1991 Census 
(7) 




Control 

(2) 


Program 

(3) 


T-test® 

(4) 


Means 

(5) 


Applicants® 

(6) 


Personal characteristics 
















Percent female 


90.7 

(0.5) 


91.6 

(0.7) 


89.7 

(0.7) 


1.90 


94.9 

(0.9) 


4.04 


100.0 


Average age 


32.5 

(0.1) 


32.3 

(0.2) 


32.6 

(0.2) 


1.11 


32.5 

(0.2) 


0.23 


34.6 

(0.2) 


Percent under age 25 


15.5 

(0.6) 


14.9 

(0.9) 


16.1 

(0.9) 


0.96 


19.5 

(1.1) 


3.13 


10.0 

(0.6) 


Percent with less than 
high school education 


41.4 

(0.9) 


41.4 

(1.2) 


41.4 

(1.2) 


0.03 


53.8 

(1.4) 


7.53 


29.2 

(0.9) 


Percent high school grads, 
no post -secondary 


38.3 

(0.8) 


37.7 

(1.2) 


39.0 

(1.2) 


0.72 


34.1 

(1.3) 


2.70 


32.2 

(1.0) 


Percent with some post- 
secondary education 


20.2 

(0.7) 


20.9 

(1.0) 


19.6 

(1.0) 


0.91 


12.1 

(0.9) 


7.05 


38.6 

(1.0) 


Percent First Nation 
ancestry 


8.9 

(0.5) 


9.8 

(0.7) 


7.9 

(0.7) 


1.95 


12.4 

(0.9) 


3.38 


11.2 

(0.7) 


Percent immigrants 


30.0 

(0.8) 


30.7 

(1.1) 


29.2 

(1.1) 


0.91 


22.6 

(1.2) 


5.18 


16.8 

(0.8) 


Percent Asian ancestry 


9.4 

(0.5) 


9.1 

(0.7) 


9.7 

(0.7) 


0.60 


6.7 

(0.7) 


3.14 


5.4 

(0.5) 


Percent with physical 
limitation 


19.8 

(0.7) 


19.6 

(1.0) 


20.0 

(1.0) 


0.31 


26.6 

(1.2) 


4.76^ 




Percent with emotional 
limitation 


7.2 

(0.5) 


8.3 

(0.7) 


6.1 

(0.6) 


2.47 


9.2 

(0.8) 


2.11 




Family background 
















Percent whose mother did 
not finish high school 


51.7 

(0.9) 


51.5 

(1.3) 


51.9 

(1.3) 


0.20 


54.2 

(1.5) 


1.41 




Percent whose father did 
not finish high school 


47.9 

(0.9) 


49.4 

(1.3) 


46.3 

(1.3) 


1.63 


50.0 

(1.6) 


1.13 




Percent lived with both 
parents at age 16 


65.1 

(0.8) 


64.6 

(1.2) 


65.6 

(1.2) 


0.61 


56.2 

(1.4) 


5.49 




Percent whose family 
received I A 


17.3 

(0.7) 


18.9 

(1.0) 


15.7 

(0.9) 


2.43 


20.9 

(1.2) 


2.71 




Familv structure 
















Number children (up to 
age 18)^ 


1.7 

(0.0) 


1.7 

(0.0) 


1.6 

(0.0) 


1.18 


1.7 

(0.0) 


1.37 


2.0 

(0.0) 


Number children under 
age 6^ 


0.7 

(0.0) 


0.7 

(0.0) 


0.7 

(0.0) 


0.30 


0.7 

(0.0) 


1.30 




Percent separated, widowed, 70.6 
or divorced (0.8) 


70.0 

(1.1) 


71.2 

(1.1) 


0.78 


54.0 

(1.4) 


10.33 


70.6 

(0.9) 

(continued) 
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Table 1, continued 



Er 


Overall 


Bv Prnoram Status 


Rr ReciDi.nt Sample 
T-test vs- 


Lone Mothers 
in BC in 
1991 Census 

(7) 




Sample 

CD 


Control 

(2) 


Program 

(3) 


T-test® 

(4) 


Means 

(5) 


Applicants 

(6) 


Percent never married 


23.7 

(0.7) 


24.7 

(1.1) 


22.6 

(1.0) 


1.37 


44.3 

(1.4) 


13.11 


26.0 

(1.0) 


Percent who own thei r 
own home 


10.8 

(0.5) 


10.7 

(0.8) 


11.0 

(0.8) 


0.30 


3.9 

(0.5) 


9.10 


34.6 

(1.0) 


lA history , 
















Average number of months of 
I A in last three years 


4.7 

(0.1) 


4.6 

(0.2) 


4.8 

(0.2) 


0.98 


29.0 

(0.2) 


95.05 




Average monthly I A payment 
at baseline^ 


862.0 

(7.4) 


874.6 

(10.4) 


849.2 

(10.5) 


1.71 


1003.2 

(8.0) 


12.98 




Expected 1 -6-month stay on 
lA on entry® 


31.2 

(0.8) 


31.2 

(1.1) 


31.1 

(1.1) 


0.06 








Expected >6-month stay on 
I A on entry® 


9.1 

(0.5) 


8.6 

(0.7) 


9.6 

(0.7) 


1.01 








Entered lA because of 
relationship breakdown® 


35.2 

(0.8) 


35.2 

(1.2) 


35.3 

(1.2) 


0.07 








Work history 
















Percent who ever worked 
for pay 


96.7 

(0.3) 


96.3 

(0.5) 


97.0 

(0.4) 


1.19 


94.6 

(0.6) 


2.87 


97.7 

(0.3) 


Average ntihber of years 
worked 


10.5 

(0.1) 


10.3 

(0.2) 


10.7 

(0.2) 


1.46 


7.9 

(0.2) 


11.29 




Percent working at baseline 


22.4 

(0.7) 


22.0 

(1.0) 


22.8 

(1.0) 


0.51 


19.0 

(1.1) 


2.55 


59.5 

(1.0) 


Sample size 


3,315 


1,667 


1,648 




1,264 




2,349 






See text. 



Notes: 



Standard errors are given in parentheses. 



A double dash indicates that the data were not available. 



'T-statistic for a test that the mean characteristics of individi«ls in the «nti^l 

prSrIm grU are the same. Significance levels for a two-ta,led t-test are 1.645 (10 percent). 

1.96 (5 percent), and 2.576 (1 percent). 



‘»T-statistic for a test that the mean characteristics of individuals in the entry effect sample 
(colum 1) and the recipient sample (column 5) are the same. 



•^Typical standard errors for the means in this row are in the range 0.02-0.03. For the census 
sample this variable is derived from the size of the family. 



^Average monthly I A received in the month prior 
individual received no benefits in that month, 



to the baseline interview, or in cases where the 
in the month following the baseline interview. 



®These variables were collected retrospectively in the 12-month interview, and pertain to the 
start of the lA spell that led to entry into the entry effect sample. 
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single parenthood, and high rates of welfare participation. As expected, recent lA applicants have 

slightly more advantaged backgrounds than people in the recipient Mpenme , 

beS on welfare for at least 12 months to be included in the sample. These recent applicants also 

have a lower incidence of physical and emotional work limitations. are 

The family structure information in Table 1 shows that family sizes of lA applicants ^e 
not much different from those of longer-term recipients. A much sharper distinction between t^ 
two groups is in marital status. Twenty-four percent of recent lA app icmts ™ ^ ^ 

dose to the fraction never-manied in the overall populahon of lone mothers, but * 

percent of longer-tenn recipients. Recent lA applicants also have a higher rate 
Lp than do longer-tem. recipients, although much lower than the ownership rate of all lone 

"'“‘^“noI surprisingly, the lA histories of recent applicants and longer-tenn recipients are quite 
different. Thi^ap is illustrated in Figure 1, which shows the fractions of the two 
ing lA payments in various months. For new appltcants the data are dt^ed relattve o 
JranZm assignment in the entry effect experiment - on average, 1-3 months after the st^ of 
a new lA spell For long-teim recipients in the main SSP expenment, the data are ahgne r 
rZ Lft of random® assignment in that experiment. Since eligibility for the ^.»t s^ 
is predicated on at least 12 months of lA receipt, lA recipiency rates are essentially 100 percent 
throughout the entire pre-baseline year. We also show post-random-assignment W rectpiency 
rates for the control groups of both experiments. New applicants leaved much faster than do 

longer-term recipients, even in the absence of any program intervention. 

Returning to Table 1, the data show that recent LA applicants have slightly lower averag 
lA benefit levels in the month before random assignment than do longer-term recipients, ims 
gap is a result of a small fraction of “partial month” lA checks among new applicants: in later 
months, average lA payments (conditional on remaining on welfare) are similar among recen 
applicants and longer-term recipients. 

Table 1 also presents some self-reported information about the reason for entering lA and 
about the expected duration of the welfare spell upon entry.“ About one-ihird of ^PP '' 

cants report that they expected to be on welfare less than six months when they ^ 

lA Another 10 percent expected a longer stay, while just over one-half of the sample had no i^a 
(or were unable to answer). Some 35 percent of applicants entered lA because 
breakdown. The remainder applied for welfare for a variety of reasons, including job loss, fman- 

cial difficulties, and so on. 

Finally Table 1 contains data on the work histories of lA applicants, longer-term recipi- 
ents, and lone’ mothers. Almost all recent applicants and long-term 
some time in the past, although only about 20 percent were working at the 
pared with the roughly 60 percent employment rate among all lone mothere m British Columbia. 
Of course, lack of employment is an important reason why many lone mothers ^e on lA. 

The descriptive data in Table 1 suggest a potentially useful taxonomy for thinking about 

-Note that individuals in the recipient experiment are unmediately eligible for an SSP supplement if they fmd 
full-time work whereas individuals in the applicant expenment must wait 12 months before estoblishmg *y. 

^*These date were collected in the 12-month survey rather than the baseline survey, and are hence retrospecti _ 
.^^e similarity of employment rates at baseline for new applicants and longer-term recipients suggests tha 
fairly steble fraction of persons on lA work while receiving benefits. 
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Figure 1 

Fractions of Individuals Receiving Income Assistance: 

Recent Applicants in Entry Effect Demonstration Versus Long-Term Recipients in Recipient Demonstration 
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Month Relative to Random Assignment 



the magnitude of any “delayed exit” effect caused by the offer of an earnings supplement for in- 
dividuals who stay on welfare for a year. On the one hand, many recent lA applicants have sub- 
stantial work histories, and 20 percent have some post-secondary education. Moreover, many 
new applicants believe that they will be on lA for only a short time. The relatively high economic 
and psychic costs of staying on welfare for these highly motivated and job-ready individu^ 
suggests that the SSP supplement offer is unlikely to influence their behaviour very much. On 
the other hand, a substantial fraction of recent lA applicants face long-run obstacles to self- 
sufficiency, including low education, physical or emotional difficulties, and unstable family re- 
lationships. Many of these individuals will remain on lA for a year or more regardless of any in- 
ducement created by the SSP supplement offer. The size of any delayed exit effect, therefore, 
depends on the behaviour of the “middle group” of single parents who are likely to remain on M 
for more than a couple of months but less than a year in the absence of the supplement offer. To 
the extent that these individuals are willing to trade off the costs of remaining on lA for sevCTal 
extra months against the benefits of a potential earnings supplement, the SSP supplement offer 
will generate delayed exit effects. 

Do People Understand the Treatment? 

A fundamental issue in any social experiment is the question of external validity: Does 
the “treatment” in the experiment accurately reflect the program innovation that the experiment is 
meant to evaluate? In the SSP experiment, this is an especially difficult question because the 
“treatment” is the provision of information about a potential benefit available under a program in 
a year hence. If the SSP supplement was made a permanent feature of the lA system, a variety of 
informal and formal networks would, in all likelihood, gradually disseminate information about 
the program. Friends and family members would relate their experiences under SSP to people 
already on lA or contemplating entry.” In addition, case workers and advocacy groups would 
inform welfare recipients and potential recipients about the program. How well did the informa- 
tion provided in the entry effect experiment mimic these channels? 

The answer to this question requires data from program group members on their knowl- 
edge about the SSP supplement and a benchmark against which to judge the quality of this 
knowledge. An obvious benchmark is the degree of knowledge about other benefits available to 
lA recipients who find work. Thus, in the 12-month survey, program group members were asked 
a series of questions about the SSP supplement offer, while people in both the program group 
and control group were asked about several key features of the British Columbia lA program. 
These features included the “earnings disregard,” which allowed people to earn up to $200 per 



"Information might not pass perfectly because many lA recipients do not tell their friends or even their children 
that they are receiving lA benefits. For example, 23 percent of individuals in the entry effect experiment who were 
still on LA after 12 months reported that they had told none of their friends about being on LA. Among those who 
had left I A within 12 months, 33 percent reported that they told none of their friends. The importance of such 
“neighborhood” effects is discussed in the context of employment and training programs for welfare recipients by 

Garfinkel, Manski, and Michalopoulos (1992). ... . . . , % u u j 

. "A survey with similar questions was also administered to a subsample of 566 individuals in (roughly) the third 
month post-baseline. The results of this survey are very similar to the results for the 12-month survey. 
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month plus 25 percent of earnings in excess of that amount without affecting their lA benefits, 
and so-called transitional benefits available to former lA recipients who find work and leave wel- 

fsrc 

Table 2 summarizes the responses to those questions. Panel A presents data for the pro- 
gram group’s knowledge of the SSP program. As shown in row 1 of panel A, three-fourths ot the 
program group recalled being informed of their potential eligibility. To probe partici^ts re- 
garding their knowledge of SSP, the researchers asked them an open-ended question; What does 
the Self-Sufficiency Project offer participants?” Fifty-five percent of the program group re- 
sponded that it offered extra money if they took a job, or they mentioned a wage supplement 
(row 2a). People who did not specifically mention the income benefits of the program were then 
asked a direct question — “Does SSP offer extra money to participants if they get a job? — and 
50 percent responded “yes.” Summing the unprompted and prompted responses, 78 percent ot 
the program group were aware that SSP offered extra income to participants (row 2b). 

Next, all individuals were asked a direct question on how long they had to stay on LA m 
order to become eligible for SSP. As shown in row 3 (panel A) of Table 2, 52 percent correctly 
responded that they had to receive lA for a year in order to qualify for tiie supplement. Finally, 
individuals were asked an open-ended question about the other eligibility requirements re- 
ceiving the SSP supplement. Just over 60 percent of the program group mentioned that they had 
to find a job to qualify for benefits, with smaller fractions volunteering that they needed to leave 
lA and work at least 30 hours per week.'' People who did not directly mention any of these three 
key requirements were then prompted with direct questions on the ones they missed. With 
prompting, the overall fractions of the program group who knew about the three key require- 
ments ranged firom 68 percent to 83 percent (see row 4b). 

Based on these responses, we conclude that at least one-half and perhaps as many as 
three-fourths of the program group had relatively precise knowledge of the SSP pro^am, in- 
cluding the facts that it would provide extra income and that the key eligibility requirements 
were receiving LA for a year and then leaving lA and working full time. 

By comparison, as shown in panel B of Table 2, 56 percent of individuals in both the 
program and control groups of the experiment knew that if individuals on lA earned up to a cer- 
tain amount of extra money, it would not affect their benefits (row 5), although only one-fourth 
knew the exact amount of the earnings disregard (row 6).” Similarly, as shown in row 7, about 
55 percent of individuals knew that some services (for example, child care subsidies) were avail- 
able to individuals who left lA. These figures suggest that a majority of lA recipients and former 
recipients have some knowledge of long-established lA benefit provisions, although the knowl- 
edge is far from complete. Knowledge of the SSP supplement among program group members of 



25 percent, or “enhanced,” disregard only applied to the first 12 months of earnings. The enhanced disregard 

was eliminated in January 1996. . 

’“This finding presumably reflects an upper bound on knowledge of the financial benefits of SSP, because some 

the prompted “yes” responses may have been guesses. cct, f.u 

’•An additional 1 1.6 percent of the program group responded that they would get money from SSP if they were on 
lA for one year from the baseline interview or simply for one year, without giving a tune frame of reference. 

’^ote that 13 percent of individuals incorrectly mentioned that they had to eruoll in schooling or trammg to re- 

ceive SSP payments. a 

»lt is possible that some persons who answered the disregard question were already workmg and were confused 

by the question, thinking that it referred to earnings above the disregard amount, which does affect then lA benefit. 
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1. Responded "yes" to question: "Were you 

informed that you would be eligible for SSP. 

2a. Without proHpting responded that SSP offers extra 
extra money "if I get a job" (or similar language) 

2b. With or without prompting responded that SSP o^ers 
extra money "if I get a job" (or similar language) 

3. Responded to question: "How long 

to be on lA to receive money from SSP? 

One year from receipt of first lA check 

Some other specified time 

Don't know 



55.2 

(1.3) 

77.5 

( 1 . 1 ) 



51.9 

(1.3) 

17.1 

( 1 . 0 ) 

31.0 



4a. Without prompting responded that one must do 
the following to receive SSP: 

Find a job 



Leave lA 

Work at least 30 hours per week 

Enroll in school or training 

4b With or without prompting knew that one 
' must do the following to receive SSP: 
Find a job 



Leave I A 



61.2 

( 1 . 2 ) 

25.7 

( 1 . 1 ) 

37.9 

( 1 . 2 ) 

13.2 

(0.9) 



83.3 

( 1 . 0 ) 

67.6 

( 1 . 2 ) 



Work at least 30 hours per week 






Table 2 , continued 

B. Knowledge of lA Program (Program and Control Group) 





Overall 


Percent 

Program 

Group 


Control 

Group 


5. Responded to question: “Can people earn money 

without affecting their I A benefit?" 

Yes 


55.5 

(0.9) 


55.6 

(1.3) 


55.5 

(1.3) 


No 


30.7 

(0.8) 


30.8 

(1.2) 


30.7 
' (1.2) 


Don't know 


13.7 

(0.6) 


13.5 

(0.9) 


13.9 

(0.9) 


6. Responded “yes” to previous question, and 
knew the maxinun amount is S200 per month 


25.7 

(0.8) 


25.1 

(1.1) 


26.3 

(1.1) 


7. Responded to question: “If someone leaves 

lA for a full-time job, are there services 
or additional benefits they can apply for?” 
Yes 


55.6 

(0.9) 


54.3 

(1.3) 


57.0 

(1.3) 


No 


21.7 

(0.7) 


23.1 

(1.1) 


20.3 

(1.0) 


Don't know 


22.6 

(0.8) 


22.5 

(1.1) 


22.7 

(1.1) 


8. Sample size° 


3,055 


1,528 


1,527 



Notes: Standard errors are given in parentheses. Tabulations are based on responses to the 
12-Month Survey. 

“The response rates for the survey were 92.7 percent for the program group and 91.6 
percent for the control group. 
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the experiment appears comparable or even better. 

A second source of information on the extent of the program group’s knowledge about 
SSP is a set of four focus-group interviews with program group members conducted about 10 
months after random assignment.^"* A total of 15 participants in two of these sessions had stayed 
on LA long enough to establish SSP eligibility (but were not yet formally notified of their status) 
while 1 5 participants in two other sessions had left LA within 4 to 1 0 months. Participants were 
recruited without mentioning SSP or the earnings supplement, and the focus group script did not 
mention SSP until the participants had engaged in unprompted discussions about their reasons 
for entering and leaving lA, and their attitudes toward LA versus work. In these exchanges only 
one individual mentioned SSP as a reason for remaining on LA. When queried about the SSP 
supplement, however, 26 of 30 participants recalled the program. Once reminded of SSP, 3 of the 
15 people who had left lA mentioned that they had been tempted to remain on lA by the supple- 
ment offer, while 1 person who had stayed on LA specifically raised the SSP supplement as a rea- 
son for remaining on welfare. These results confirm that individuals in the program group had 
some knowledge of the SSP supplement, although the offer seemed to have played a limited role 
in the decision to leave or remain on LA for most individuals. Moreover, the SSP treatment, 
which consisted of letters and brochures, seems to have replicated what lA recipients might be 
expected to know about a “real world” SSP type of program through word of mouth and other 
formal and informal means of communication. 

Impacts on Delayed Exits and Labour Market Outcomes 

We now turn to behavioimil comparisons between the program group and the control 
group in the entry effect experiment. We focus on three LA-related outcomes and three labour- 
market-related outcomes for each month after random assignment. The LA-related outcomes are 
an indicator for whether the individual is still potentially eligible for SSP (explained below), an 
indicator for whether the individual is on LA, and the amount of LA received in the month. These 
variables are all derived fi'om LA records and are available for the full sample of 3,315 individu- 
als in the applicant experiment. The three labour-market outcomes are an indicator for whether 
the individual worked in the month, total monthly earnings, and the total number of hours 
worked in the month. These variables are derived from the 12-month survey, and are available 
only for the subset of 3,055 individuals who completed that survey.^* 

Basic Impacts on lA-Related Outcomes 

The primary focus of the applicant experiment is the question of whether some individu- 
als would prolong their stay on lA in order to gain SSP eligibility. Although program group 



’^These are described and summarized in Bancroft (1996). 

’^e response rates for the 12-month survey were 92.7 percent for the program group and 91.6 percent for the 
control group. The gap (1.1 percent) is not statistically significant (t=1.2). Since the 12-month survey was adminis- 
tered after individuals had been on lA for 1 1-12 months, and the baseline survey was conducted 0-4 months into 
the lA spell, the 12-month survey provides between 7 and 12 months of post-baseline labor market data. All indi- 
viduals have 7 months of survey data; 99.7 percent have 8 months; 97.7 percent have 9 months; and 80.2 percent 
have 10 months of data. Appendix Table 1 shows the numbers of months of post-random assignment data available 
for the overall sample and for individuals with different numbers of LA checks pre-random-assignment. 
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members were informed that they had to remain on lA continuously for 12 months in order to 
qualify for SSP, the actual eligibility criterion was relaxed slightly to permit up to one month off 
I A in the first 13 months after entering the system. This slippage was introduced to allow for die 
possibility that an individual might not receive a check in a certain month because of things like 
atypically high earnings. An individual in either the program group or the control group was 
therefore “potentially eligible for SSP” in a certain month if she had received an lA check in 
every month after her first check, or had missed at most one monthly check. 

Figure 2 shows the fractions of individuals in the program group and control group who 
had been on lA continuously in each month since receiving their first check, and also the fi’ac- 
tions who met the less stringent SSP eligibility rule (all but one month on LA). Figure 3 shows 
the fi’actions of individuals in the program group and control group who received LA in any given 
month. In interpreting these figures (and as can be seen fi’om Figure 3), it is important to keep in 
mind that different individuals may have received between zero and four lA checks before their 
baseline interview. Thus, a few individuals actually reached SSP eligibility (that is, had amassed 
12 months on lA) by the eighth month after random assignment, whereas some other individuals’ 
final eligibility was determined only in month 13. The SSP eligibility variable (Figure 2) is 
coded as 1 for all individuals who are still potentially eligible (that is, have missed no more than 
one LA check) or have already reached eligibility: hence, the full impact of the entry-effect 
“treatment” is measured by the variable representing potential eligibility in month 13.” The ef- 
fect on lA receipt in month 13, on the other hand, may combine positive entry effects with nega- 
tive “exit” effects resulting fi’om qualified individuals leaving lA to take up the SSP supplement. 

The data in Figures 2 and 3 show evidence of a modest delayed exit effect among the 
program group relative to the control group. The magnitude of the effect is similar using either 
the fi*action of people on I A continuously for 12 months since their first lA check, the potential 
eligibility variable, or the simple lA receipt variable. After a year, about 2.5 percentage points 
more of the program group than the control group are still on lA or still potentially eligible for 
SSP. Interestingly, the relative fi’action on lA reverses by the sixteenth month, presumably re- 
flecting the impact of SSP take-up by the program group. (See below.) 

Table 3 presents more detailed information on the eligibility rates and other outcomes of 
the program and control groups. For each outcome variable in each month after random assign- 
ment, the table shows the mean outcome among the control group, the mean outcome among the 
program group, the “raw” program impact — which is simply the difference in mean outcomes 
between the programs and controls — and an “adjusted” program impact, which is the coefficient 



“Members of the control group were never offered SSP, but their eligibility status is needed to derive an estimate 
of the “treatment” effect. 

. ’■'Because of the program rules, the SSP eligibility variable doesn’t change after the thirteenth month for either 
program or control group members (i.e., the lines in Figure 2 become flat). 
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Figure 2 • 

Fraction of Individuals On Continuous Income Assistance and Fraction Still Eligible for SSP: 
Program Group Versus Control Group 
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Fraction of Applicants Receiving Income Assistance Benefits in Any Given Month 
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Month Relative to Random Assignment 
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'Table 3a, continued 
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of a dummy variable for program group members in an ordinary least squares (OLS) regression 
model that includes 42 baseline characteristics as additional covariates. Although the random- 
ized design ensures that valid program estimates can be obtained without controlling for the 
characteristics of individuals in the two groups, the addition of the covanates may lead to more 
precise estimates, and also adjusts for any minor differences in the distribution of the baseline 

characteristics between the program and control groups. 

An examination of the program impacts in Table 3 suggests two key conclusions. Fu^t, as 
indicated in Figures 2 and 3, the magnitude of the delayed exit effect among new lA applic^ts is 
relatively modest. The unadjusted program impact on final (month 13) SSP eligibility is 2.6 per- 
centage points (t-ratio = 1.52; p-value = 0.13) while the adjusted impact is 3.1 percentage points 
(t-ratio = 1.88; p-value = 0.06). The impacts on the fi-action of the sample receiving LA are quite 
similar, at least up to the eleventh month, when the majority of the sample are in their twelfth 
month of welfare recipiency. For example, the unadjusted impact on the probability of lA receipt 
in month 1 1 is 3.1 percentage points (t-ratio = 1.88; p-value = 0.06), while the adjusted impact is 

3.4 percentage points (t-ratio = 2.13; p-value = 0.03).” 

Second, the fact that the estimated impacts are close to zero in the first few months after 
random assignment suggests that very few people who would normally leave LA within fom 
months are willing to extend their spell up to a full year in order to become eligible for SSP. 
light of this finding, we believe it is unlikely that the availability of the SSP supplement would 
induce many people who would otherwise not be on LA at all to enter welfare and stay for a full 

year. (That is, a “new applicant” effect is unlikely.) 

While the delayed exit effects induced by the SSP supplement offer are quite modest (on 
the order of 3 percentage points), it is important to note that the eligibility behaviour of a major- 
ity of LA recipients is presumably unaffected by the offer. In particular, there can be no program 
impact on the eligibility status of the 54 percent of the applicant population who are eligible even 
in the absence of the supplement offer (that is, the fi-action of the control group who are eligible 
in month 13). Moreover, very little (if any) impact would be expected among individuals who 
would normally leave I A within a couple of months (10-20 percent of the applicant population), 
and no such impact is evident in the data. Thus, the eligibility status of roughly 70 percent of all 
new lA applicants is presumably unaffected by the offer of SSP. A 3 percentage-point impact on 



^“These additional covariates are age, age-squared, a dummy for age under 25, and a dummy for people whose age 
had to be allocated; a Vancouver site dummy; a male gender dummy; two dummies for less than high school or 
more than high school education; counters of the number of children aged 0-5, 6-12, 13-18, and the number of 
other adults in the household; a married dummy; a dummy indicating that the individual’s parents had received lA; 
the number of months on lA in the four years prior to the baseline and in the last two years; a dummy for no lA in 
the two years prior to the current spell; a counter for the number of times the mdividual moved in the past five years 
and dummies for individuals who own their own home or receive housing subsidies; the number of years the indi- 
vidual has worked and a dummy if she never worked; indicators for the presence of physical or emotional work 
limitations; a dummy for individuals bom in Canada and dummies for seven ethnic groups (Asian, First Nation, 
Indian Middle Eastern, Black, Latin American, European, or Canadian); indicators for workmg at the baselme and 
looking for work; four indicators for having zero, two, three, or four lA checks at the baseline, and mteractions of 

these dummies with the indicator for working at the baseline. 

'’Actually, the largest impacts on lA receipt and benefits occur in month 9, but the impacts in this month are not 
significantly different from the impacts in month 1 1 . 
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the overall fraction of individuals eligible for SSP suggests a behavioural change in roughly 1 in 
10 of the remaining population. 

Time Pattern of the Impacts 

Although the program impacts on SSP eligibility in Table 3 are all small and somewhat 
imprecise, it is interesting to study the time pattern of impacts in the later months of the experi- 
ment. In particular, it is interesting to ask whether the 12-month eligibility criterion leads to a 
bigger impact on the behaviour of the program group as the eligibility threshold approaches. For 
example, in any given month a certain fr’action of both the control group and the program group 
who are still on welfare may learn of new job opportunities or resolve the personal problems that 
prevent them fr’om working. The availability of SSP might lead some program group members in 
this situation to remain on lA, even though they would leave LA if they were in the control ^oup. 
Furthermore, the fr’action of the program group who decide to wait until the end of their eligibil- 
ity window before leaving LA might rise as the number of additional months on LA needed to es- 
tablish SSP eligibility falls. Such behaviour would lead the estimated program impacts to widen 
toward the end of the eligibility window.'*® Examination of the data in Table 3 shows limited evi- 
dence of widening impacts in the last months of the experiment. For example, between months 9 
and 13 the unadjusted impact on SSP eligibility rose by 0.8 percentage point. 

Nevertheless, the fact that month 9 of the applicant experiment includes data for indi- 
viduals who have been on lA for 9-13 months makes it difficult to draw precise inferences on the 
time pattern of the program impacts. To investigate timing issues more clearly, we re-estimated 
the impacts for the 70 percent of the sample who had received exactly one lA check prior to ran- 
dom assi gnm ent. All the program group members of this subsample reach the end of their SSP 
eligibility determination period in month 12 of the experiment. The estimated impacts for this 
one-check subsample are presented in Appendix Table A2 and show a similar pattern to the es- 
timates in Table 3, although the magmtudes of the overall program effects on SSP eligibility and 
LA recipiency are slightly smaller than the impacts for the overall sample. As in Table 3, the pro- 
gram impacts for the one-check subsample rise slightly over the last four months of the experi- 
ment but show no sharp increases in the last one or two months.*' 

An alternative way of examining the timing issue is to align the data for all individuals by 
the number of months since entering welfare.*^ Appendix Table A3 shows the fr"actions of indi- 



^ote that the potential magnitude of any widening is limited by the rate the control group loses SSP eligibility. 
For example, if all the program group members who were still eligible for SSP in month 10 (60.7 percent) had 
stayed on welfare for the next two months, the growth in the magnitude of the program impact from month 10 to 
month 12 would equal the fraction of the control group who left lA in months 1 1 and 12 (3.4 percent of the control 
group). 

^'To determine whether impacts varied with the number of months of eligibility pnor to random assignment, we 
ran regressions for each post-random assignment month (1 through 13) with the full set of covariates plus interac- 
tions between the number of lA checks received prior to random assignment (which ranged from zero to four) and 
the program group dummy. The dependent variables in these regressions were the indicators for whether the indi- 
vidual is still potentially eligible for SSP and whether the individual is on lA in a given month. Out of 26 sets of 
interactions (13 months, two dependent variables), only 3 were statistically significant at the 10 percent level or 
lower. None was significant after month 5. We conclude from these results that response to the SSP offer does not 
vary with the number of months remaining to establish eligibility subsequent to random assignment. 

^^A disadvantage of this approach is that different individuals in the program group have known about the avail- 

(continued) 
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viduals in the control group and the program group who left lA in each monA after first entering 
welfare (up to month IS)/^ A chi-squared test on this table shows no signific^t overall ditter- 
ence between the program group and the control group (the p-value is 0.61). However, a com- 
parison of the associated survivor functions for the two groups reveals a pattern simito to the 
pattern of being on lA shown in Table 3.^ Estimates of the differences between the raw fi-actions 
of individuals still on lA in the program group relative to the control group m each month since 
entering lA are also tabulated in Appendix Table A3, along with regression-adjusted estimates ot 
these differences. In the twelfth month after entering lA, for example, an extra 2.7 percent of the 
program group is still on lA relative to the control group. The regression-adjusted estimate of 
this gap is 3 percentage points, and is just significant at the 10 percent level. As m Table 3 an 
Appendix Table A2, the excess flection of the program group on lA tends to nse over rime, al- 
though there are no sharp jumps in the eleventh or twelfth month on welfare. We conclude that 
the magnitudes and time patterns of estimated program impacts m the applicant expenment are 
quite robust to the way the data are aligned. 

It may seem surprising that the availability of SSP did not have a stronger impact on lA 
receipt near the end of the eligibility window, when program group members who were still e i- 
gible needed only a few more months on lA to establish eligibility. However, as we have indi- 
cated, the fi-action of individuals on lA in the control group does not change much dunng the 
latter’months of eligibility for SSP, suggesting that the excess firaction of the pro^am group re- 
maining on LA cannot change much during these months. Additionally, it is possible that discom- 
fort with being on welfare, even for only a few more months, might be strong enough to 
outweigh the potential benefits of SSP . 



Labour Market Impacts 

The second panel of Table 3 (Table 3b) and Figures 4-6 show the means and program 
impacts for the three labour market outcomes.''* The labour market data for the control group 
show steadily increasing employment, earnings, and hours in the months following random as- 
signment. Although it might have been expected that the delayed lA exit behaviour of the pro- 
gram group would be reflected in a parallel “delayed labour market entry” effect (that is, a 
negative impact on the labour market outcomes), the program group actually had slightly bigger 



ability of SSP for differing amounts of time. 

"’Month 13 in Appendix Table A3 is nor the same as month 13 in Tables 3 and 5. . 

"mie survivor function is simply the fraction of individuals who are still on lA m a given monA smce first re- 
ceiving lA. The survivor functions of the program and control groups relative to the month of random assignment 

^^"’wH^fo^stoated a series of Weibull hazard models for the rate of leaving lA. Excluding covanates, these mod- 
els show a 7 4 percent lower rate of leaving lA for program group members, but the effect is not stotistically signifi- 
cant (p-value=0 14) When covariates are added to the Weibull model the rate of leaving lA for the program group 
»94 p=4I7ow=r end is siadsdcally significam a, convendonal levels (p-value-.Od), I, should be noted that haz- 
ard models are appropriate only for estimating differences between a program group and a control group under ex- 
tremely restrictive assumptions — see, for example, Ham and LaLonde (1996). , f 

"mie labor market impacts for each month are derived using the sample of individuals with labor market data for 
that month For months 1-7 the sample size is 3,055 (1,528 controls, 1,527 programs); for month 8 the sample size 
!s3,045 (i',521 controls, 1,524 programs); for month 9 the sample size is 2,986 (1,493 controls, 1,493 programs); 
and for month 10 the sample size is 2,450 (1,241 controls, 1,209 programs). 
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Figure 4 

Average Monthly Earnings, Applicant Sample 




Figure 5 . „ , 

Average Monthly Hours Of Work, Applicant Sample 




Average Monthly Employment Rate, Applicant Sample 









gains in employment, earnings, and hours than did the controls. Closer examination of the data 
(not reported in Table 3) reveals that the probability of working while receiving lA rose slightly 
in the program group relative to the control group, whereas the probability of working and not 
receiving lA fell slightly.*” Since neither relative effect is statistically significant in most months, 
however, these differences must be treated cautiously. 

Variation in Impacts Across Subgroups 

As we have emphasized, the availability of SSP would not be expected to exert the same 
effect on the behaviour of all recent lA applicants. Applicants who would otherwise experience 
very short or very long LA spells are presumably less likely to change their behaviour than those 
who would otherwise leave lA in 6-12 months. One way to evaluate the potential variation in 
program impacts is to estimate models in which the program effect is allowed to vary by individ- 
ual characteristics that may be correlated with the expected length of stay on welfare. Table 4 
presents simple F-tests for the inclusion of such program interaction effects in OLS regression 
models for the events of final (month 13) SSP eligibility and receiving lA in month 11.“* All the 
models include the 42 baseline covariates as main effects; different rows of the table add interac- 
tions of subsets of the covariates with the program group dummy 

The test results show little indication that the SSP program impact varies systematically 
across individuals; none of the sets of interaction effects is jointly sigmficant at even the 20 per- 
cent level.*® Of course, even assuming a homogeneous treatment effect, the estimated program 
impacts are only marginally sigmficant. Given the small magmtude of the mean program impacts 
and the relatively small sample sizes in the experiment, it is difficult to identify statistically sig- 
nificant differences across subgroups. 

“Informed” Versus “Uninformed” Program Group Members 

Although the evidence in Table 2 suggests that 50-75 percent of the program group had 
fairly precise knowledge of the SSP program, a sizeable minority were relatively poorly in- 
formed. Judging by welfare recipients’ knowledge of other income assistance features, some 



is possible that in anticipation of becoming eligible for SSP and working full time, some program group mem- 
bers might take part-time jobs the months following random assignment, so that employment would be actually 
higher among program group members relative to control group members. 

^®As indicated earlier, these are not the months with the largest impacts, but interactions for every other post- 
baseline survey month yield the same conclusions. 

^’Specifically, we present probability values for the test y =0 in OLS regression models of the form: 
y, = Pfi + A'.P + PA.Y where y, is the dependent variable for individual i. P, is a dummy for membership in the 
program group, X, is a set of baseline characteristics for individual i, ot, P, and y are parameters to be estimated, and 
e, is a residual. 

“If we consider only residential mobility alone (one of the three characteristics in row 7 of Table 4), a significant 
interaction effect occurs on the probability of receiving lA benefits. If the individual had not changed residences in 
the five years prior to baseline, the program group has a statistically significant 10-percentage-point higher prob- 
ability of receiving lA than the control group. For each residential move within the prior five-year period, the im- 
pact is reduced by a statistically significant 2 percentage points. This suggests that entry effects are more likely for 
lA recipients with a more stable social and economic environment. These may also be individuals with a greater 
knowledge of the “rules” of the welfare system, which, in turn, might lead them to comprehend more fully the ad- 
vantages offered by SSP. 
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Table 4: Tests for Variation in Program Impact on Probability of SSP 
Eligibility and lA Receipt in Month 11 Across Subgroups 



Interaction Added to Base Specification 


Nunber 
of Inter- 
act i ons 


P- values of 
Interaction Termsi 
Eligible lA. month 11 


1. Age effects (quadratic plus indicators for 
age under 25 and for allocated age) 


4 


0.43 


0.63 


2. SSP site (Vancouver vs. New Westminster) 


1 


0.80 


0.70 


3. Gender (male vs. female) 


1 


1.00 


1.00 


4. Education (indicators for less than high 
school and some post -secondary) 


2 


0.55 


0.84 


5. Family structure at baseline (mmbcr of 
children in three age ranges, 0-5, 6-12, 
and 13-18; number of other adults; married 
dunny) 


5 


0.73 


0.92 


6. lA history (number of months of lA in last 

four years and last two years; dummy for no lA 
in last two years; dumiy if parents on I A) 


4 


0.62 


0.29 


7. Characteristics of home (indicators for 
owning home and receiving rent subsidy; 
mmber of residential moves in last five years) 


3 


0.58 


0.86 


8. Employment history (indicator for no job 
experience; nunber of years of work 
experience) 


2 


0.27 


0.26 


9. Employment status at baseline (indicators 
for working or looking at baseline; 
indicators for physical or emotional 
limitations on work) 


4 


0.98 


1.00 


10. Nativity/ethnicity (indicators for 

Canadian born and for seven ethnic groups) 


8 


0.35 


0.58 


11. Duration of lA spell at baseline and 
interactions of length of spell (with 
dummy for working at baseline) 


8 


0.93 


0.86 


12. All interactions 


42 


0.38 


0.53 



Notes: Table reports the probability values of F-tests for the exclusion of 
interactions of the prog ram- group dimny with various other covan at es, 
in OLS regression models for the event of eligibility for SSP in month 
13 and the event of receiving lA benefits in month 11. All models are 
estimated on a sample of 3,315 observations for the program group and 
control group, and include a program group dimmy and 42 covariates. 
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people would be unfamiliar with the supplement program even if SSP were a permanent feature 
of the lA system. Nevertheless, the program impacts estimated in Table 3 might be larger if more 
of the program group were fully informed about the nature of SSP. 

Since all members of the program group were provided with the same information, it is 
not possible to conduct an experimental evaluation of the effects of different levels of informa- 
tion on the magnitude of the delayed exit effect. As an alternative, we used the responses to the 
question “how long does someone need to be on income assistance to receive money from 
to divide the program group into those who were well informed about SSP (as of the 12-month 
survey) and those who were less informed.*' Just over one-half of the program group were well 
informed by this criterion (see Table 2). We then compared SSP eligibility and LA recipiency 
rates of the informed and uninformed subgroups with the rates of the control group. 

It is important to underscore that such comparisons are not necessarily valid, since indi- 
viduals in a selective subset of the program group may differ systematically from members of the 
overall control group. Some of these differences may be eliminated by controlling for observed 
characteristics in a standard regression framework. Other unobserved differences may persist, 
however, leading to differences in behaviour that are not attributable to a true program effect. 

Since knowledge of SSP was measured in the 12-month survey, we can distinguish only 
between informed and uninformed program group members within the subset of those who re- 
sponded to that survey. We therefore restrict attention to program group members and controls 
who responded to the 12-month survey. The first four columns of Table 5 show the fractions of 
the control group, the overall program group, and the informed and uninformed subsets of the 
program group who were still potentially eligible for SSP in different months after random as- 
signment. The next two columns show raw and regression-adjusted estimates of the impact of the 
supplement offer on potential SSP eligibility for the overall program group relative to the control 
group. These show a similar time pattern to the estimates in Table 3, although the impact esti- 
mates for the subsample of respondents to the 12-month survey are slightly larger in magnitude 
than the estimates for the full sample in the applicant experiment. For example, the adjusted im- 
pact on potential SSP eligibility in month 13 is 3.5 percentage points among the 12-month survey 
responders, versus 3.1 percentage points in the entire sample. 

Comparisons of SSP eligibility within the two subsamples of the program group show 
that the informed program group members are less likely to have remained on lA and retained 
SSP eligibility than those in the uninformed program group. This gap is consistent with other 
features of the two subgroups; for example, the uninformed group has a significantly larger frac- 
tion of high school dropouts and immigrants, whereas the informed group has a noticeably higher 
fraction of people who were working at the time of the baseline survey. Consequently, as shown 
in the “raw program impact” columns of Table 5, the gaps in SSP eligibility between the in- 
formed subgroup and the overall control group are slightly smaller than the corresponding gaps 
between the uninformed subgroup and the overall control group. Adjustments for the observed 
characteristics of the different subgroups raise the program impacts for the informed group and 
lower them for the uninformed group. As indicated by the test statistics in the final column of the 



’’Recall that the 12-month survey was administered just before individuals in the program group were informed of 
their SSP eligibility status. 
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table, however, the differences in the adjusted impacts for the two subgroups are generally not 
statistically significant. 

The adjusted impacts for the informed and uninformed subgroups are suggestive. On me 
one hand, the adjusted impacts for the uninformed program group are small and uniformly insig- 
nificant, consistent with the hypothesis that few uninformed individuals actually changed their 
behaviour in response to the SSP offer. Their higher rates of SSP eligibility than either the con- 
trol group or the informed program subgroup are attributable to such characteristics as low edu- 
cation that make them less likely to leave lA even in the absence of a program impact. On the 
other hand, the adjusted program impacts for the informed subsample are about 30-40 percent 
larger than the adjusted impacts for the program group as a whole, and statistically significant 
throughout the later months of the eligibility determination period. 

It is possible (but by no means necessarily the case) that these adjusted impacts represent 
an upper bound on the impacts that would be observed with much more intensive information 
being disseminated about SSP. In particular, two things must be true for the adjusted impacts of 
the informed subgroup to represent such an upper bound. First, there can be no unobserved dif- 
ferences between individuals in the informed subgroup and the control group that lead to differ- 
ences in their lA participation behaviour. Second, the behavioural effect of the SSP supplement 
offer must be the same for the informed subgroup and for people in the uninformed subgroup 
who could potentially respond to the SSP offer if they understood it. Since we do not know 
whether these two conditions are satisfied, we reiterate that the estimates in Table 5 must be in- 
terpreted very cautiously. 

Summary of Impact Estimates 

To summarize, the impact estimates in Table 3 and Figures 2-6 suggest a modest delayed 
exit effect on the welfare participation of the program group, but no corresponding reduction in 
labour market activity. The estimated impacts on LA receipt, average lA benefits, and potential 
SSP eligibility emerge between the fourth and tenth months of the experiment and peak near the 
close of the 12-month eligibility window. The peak impacts are about 3 percentage points, and 
are just significant at the 10 percent level. There is no indication that the program impacts vary 
systematically across individuals with different baseline characteristics, although this might be 
explained by the modest magnitude and only limited statistical significance of the overall pro- 
gram impacts. Finally, program impacts for the roughly 50 percent of the program group who 
were well informed about SSP near the end of their 12-month waiting period for potential eligi- 
bility are about 30-40 percent larger than the impacts for the entire program group. These im- 
pacts suggest an upper-bound estimate of about 5 percentage points on the delayed exit effect of 
the SSP supplement offer, if all lA applicants were well informed. 

Post-Eligibility Behaviour 

Identifying a Comparison Group from the Recipient Experiment 

Having found some evidence of a modest delayed exit effect among the program group 
members, it is of interest to compare the SSP take-up rate of program group members who be- 
came eligible for the supplement with the take-up rate of program group members in die recipi- 
ent experiment. While people in the entry effect experiment knew in advance of their pending 
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eligibility for SSP, pregram group members in the recipient 

w^ng ” Assuming that the supplement offer causes some people to P™'“"8 i J 

fare these delayed leavers would be expected to take up the supplement offer relatively quick y 
o"; te r eSty is established. Evidence that eligible individuals in the ent^ 
r^tTie upfte lungs supplement at a faster rate than "e -mtto^ 
recipient experiment would therefore represent corroborating evi en PP 

exit effe^ is that the comparison should involve otherwise similar individuals 

in the two experiments. As noted in the discussion of Table 

rolled in the SSP recipient experiment are, on average, less to estab- 

applicants enrolled in the entry effect experiment. Even after spending 12 mo 
lish SSP eligibility individuals in the applicant experiment still have less time on welfare, o 
“ do in the recipient experiment It would not be surpnsmg, then, to see a 

faster exit rate fi-om welfare and onto SSP among the applicants than the recipients. 

Within the recipient sample it is nevertheless possible to identify mdtviduds ^ho'e wel- 
fare histories are similar to those in the new applicant sample. Ftgum 7 J 

individuals receiving lA benefits in various pre-basehne months for ttoe 
the program group in the entry effect experiment who became eligible for SSP ( eligible appli 
cants"),^e entire sample of single parents in British Columbia in the recipient 
whom are eligible), and a subset of the British Columbia recipients who were off lA 17 or 18 
months prior to the recipient baseline (again, all of whom are 

tween exDeriments a new “baseline” is defined for the recipient group that is 11 monfts later 
than their actual beeline, so that the recipients become eligible for SSP m (roughly) e same 

month “ Columbia ^ 

higher rate of lA participation in the pre-baselme penod than does the sample o e igi ® PP 

c^s. This is a result of the applicant sample’s eligibility criterion, which required individuals to 

be off lA in the six months prior to their baseline month. When a similar PP 

the recinients the pre-baseline lA rates of the resulting subsample are very close to those of the 

eligible applicants. Thus, a natural comparison group for the post-eligibility 

plLts iV the subset of recipients with a similar lA history, although unobserved differences 

may remain between the two groups. 

SSP Take-Up and Notification of Eligibility 

After individuals in the program group had completed their 12-month intereiew (^ically 
in the tenth or eleventh month after random assignment). SSP eligibility was determined by re- 
li^mgt most recently available lA reeords.“ SSP-eligible individuals ^ 
mail of their status, and invited to attend an SSP orientation session similar to the one offered to 
individuals in the recipient experiment. A total of 93 percent of eligible individuals m the appli- 



“The SSP design called for the suivey to be fielded in the twelfth month of lA receipt, prior to eligibility deteimU 
natil^ In^tw^Sag^^ in the Leenth and, if necessary, the fourteenth month ^ 

determination for some cases. If the third interview attempt faded, ehgrbrhty was de- 
termined without the 12-month interview. 
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Figuref 7 

Income Assistance Histories of SSP-Eligibie Applicants. SSP-Eligible Recipients, and SSP-Eligible Recipients 
Who Were Off Income Assistance 6-7 Months Prior to Start of Spell that Established Eligibility 
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cant experiment attended such a session, compared with 95 percent m the ' 

Once informed of their SSP eligibility, individuals had 1 2 months to find full-time , 
leave lA, and begin receiving SSP payments. SSP was available for up to 36 months after Ae 
first supplement pay period. Supplement initiators who lost a job could return to lA at ^y hme 
during their three-year eligibility window, and re-mitiate supplement paymen s w 
hours exceeded the minimum threshold. Operational details of supplement program are de- 
scribed in more detail in Mijanovich and Long (1995) and Card and RobiM (199 ). 

Table 6 shows the fractions of eligible applicants who take up SSP m eac 
lowing notification of SSP eligibility, and comparable fractions of individuals m 
experiment who take up SSP in each month after being intoed of their 
table shows that the eligible applicants did not move into SSP relatively more q y 
subsample of recipients who had similar lA histories. In fact, eligible 

move into SSP more quickly, although not significantly so. For ex^ple, within two monftis of 
notification, 10.6 percent of the eligible applicants had taken up SSP, compared with . p 
cent of the similarly chosen recipient subsample. The difference (shown m the t-most co i^ 
of Table 6) is not statistically significant, suggesting that the behaviour of eligib e app * 
that of similarly chosen recipients is essentially the same. By the four* month, the differei^ce 
narrows and thereafter the take-up rates of the eligible applicants exceed the take-up rates of the 
similarly chosen recipient subsample but, again, the differences are not statistically sigmfic^t 
Both groups have much higher take-up rates than the overall recipient pro^am group, consistrat 
with the fact that recipients as a whole have much higher pre-baseline welfare participation rates 
(see Figure 3), and would not be expected to move to full-time work as quickly. 

These simple comparisons of SSP take-up behaviour do not support the notion that a sub- 
set of applicants are delaying their exit from lA to qualify for SSP and immediately take jobs. 
However, after about five months, there is evidence that the SSP take-up rate among applic^ts 
exceeds the take-up rate of similar recipients by about the amount of the delayed exit effect (3 
percentage points), but the difference is not statistically significant. Although t^e-up of SSP 
among applicants and similar recipients does not appear to be different (especially m the ear^y 
months), these results should be treated with caution, because we cannot be certain that the 
groups being compared have identical unobserved characteristics that induce them to seek em- 
ployment and hence become eligible for SSP. 



Conclusions 

Any targeted social program runs the risk of inducing people to change their behaviour in 
order to become eligible for the program. In the case of training progi^s or e^mgs supple- 
ments for welfare recipients, previous analysts have argued that these entry effects ^ou\dhc 
sizeable and could account for a significant portion of the overall costs of the pro^am. In the 
Self-Sufficiency Project, the possibility of entry effects was recognized e^ly o". and a separate 
experiment was conducted to measure their importance. For a program like SSP, there are two 
potential sources of entry effects. On the one hand, people who othenvise would not be on wel- 

“Briefly, individuals were required to mail in pay stubs (or similar information) for the purpose of validating their 

hours and earnings. . . 

*^By month 8 the difference narrows and remains statistically msignificant. 



Table 6: Comparisons of SSP Take-up Rate Among Eligible Program Group Hem^s of 
Entry Effect Demonstration and British Coluitola Program Group Members of 
Recipient Demonstration 



Months 

Since 

Notified 

Eligible 


Eligible 

Applicants 

(1) 


Percent Who Have Begun SSE 

RC Rer i ni enf e : 0 i f f erence : 

Subset Off lA in Colum 1 - 

All Pre-baseline Period Colum 3 

(2) (3) (4) 


1 


7.1 


5.0 


9.7 


-2.6 


(0.8) 


(0.8) 


(3.0) 


(3.0) 


2 


10.6 


7.4 


14.6 


-4.0 




(1.0) 


(1.0) 


(3.5) 


(3.6) 


3 


13.9 


9.2 


14.6 


-0.7 




(1.1) 


(1.1) 


(3.5) 


(3.7) 


4 


18.9 


12.2 


18.4 


0.5 




(1.3) 


(1.2) 


(3.8) 


(4.0) 


5 


21.5 


13.4 


18.4 


3.1 




(1.3) 


(1.3) 


(3.8) 


(4.0) 


6 


23.3 


15.5 


21.4 


1.9 




(1.4) 


(1.4) 


(4.1) 


(4.3) 


7 


25.7 


17.4 


23.3 


2.4 




(1.4) 


(1.4) 


(4.2) 


(4.4) 


8 


27.4 


20.0 


26.2 


1.2 


(1.5) 


(1.5) 


(4.4) 


(4.6) 


Sample size 


938 


714 


103 


N/A 



Notes: Standard errors are given in parentheses. N/A = not applicable^ Table 
entries are percent of group who have begun receiving SSP supplement 
payments for work in indicated month. 8C = British Colimbia. 
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fare at all may apply for lA in order to become eligible for SSP (a “new applicant effect). On 
the other hand, some welfare recipients who would normally stay on lA for less thm a year may 
extend their stay in order to meet the one-year qualifying period (a “delayed exit” effect). The 
SSP entry effect experiment was limited to measuring delayed exit effects, for two reasons. First, 
conducting an experiment to test for the possibility of a new applicant effect would be very ex- 
pensive, since a fairly large sample of single parents would be needed to detect statistically sig- 
nificant impacts. Second, because of the stigma and costs associated with applying for lA, the 
new applicant effect is likely to be considerably smaller than the delayed exit effect, and may m 

fact be close to zero. . j ra 

Our analysis of the delayed exit effect suggests that it is fairly small, on the order ot 3 

percentage points (that is, 3 percent of all new applicants for lA). There does not appear to be 
any corresponding effect on the labour market outcomes of individuals potentially eligible for 
SSP. (It was expected that a delayed exit from LA would cause a delayed labour market entry ef- 
fect.) There are several explanations for the modest size of this delayed exit effect. Over one-half 
of new welfare applicants stay on income assistance for a year or more anyway. Moreover, short- 
term welfare recipients appear to be unaffected by the offer of an SSP supplement. Thus, only 
about one-third of new applicants to income assistance are substantially “at risk” of changing 
their behaviour in response to the supplement offer. Finally, as is true for other features of the 
welfare system, not all participants in the entry effect experiment were fully aware of the details 
of the SSP supplement offer. Our analysis indicates that people in the program group of the ap- 
plicant experiment had as much or even more information about SSP than typical welfare recipi- 
ents had on other LA programs. Even among the well-informed subset of the program group, 
however, the delayed exit effect is relatively modest — on the order of 5 percentage points. On 
balance, the evidence suggests to us that the 12-month eligibility restriction for the SSP program 
successfully limits the size of the overall entry effects generated by the supplement offer. 

Our finding that short-term income assistance recipients were imaffected by the supple- 
ment offer suggests that the “new applicant” effect generated by SSP may also be negligible. If 
people who have already borne the costs and stigma of applying for welfare are imwilling to stay 
on income assistance for an additional 9-12 months to get the supplement, we suspect that peo- 
ple who are close to the margin of applying for lA would be similarly unaffected. 

The fact that entry effects appear to be small in SSP is noteworthy because the financial 
incentives offered by SSP are substantial. Moreover, compared with other kinds of welfare inno- 
vations, like requirements of training, SSP has no offsetting deterrent effects. If a generous pro- 
gram like SSP has such modest entry effects, we suspect that the entry effects associated with 
other welfare innovations having similar waiting periods and work requirements may also be 
small. Of course, further empirical tests of entry effects for other kinds of programs are needed 
before such a conclusion can be judged as definitive. 





Appendix Table A1: Receipt of Income Assistance Prior to Random Assignment and 12' 
Interview Status 



Month 



Number of I A 
Checks Received 


Number of 
Cases 
(X of all 

cnQPC ) 




1? Month Interview Status 

Respondents (by Number of Montis for 
Data UAr» rntlected") 


Which 


Prior to Random 


Nonrespondents 


8 


9 


10 


11 


12 * 


ASSignncnt 

4 


11 

(.3) 


1 

(9.1) 


10 

(90.9) 


0 

(0.0) 


0 

(0.0) 


0 

(0.0) 


0 

(0.0) 


3 


81 

(2.4) 


8 

(9.9) 


0 

(0.0) 


59 

(72.8) 


8 

(9.9) 


4 

(4.9) 


2 

(2.5) 


2 


653 

(19.7) 


49 

(7.5) 


0 

(0.0) 


0 

(0.0) 


528 

(80.9) 


64 

(9.8) 


12 

(1.8) 


1 


2,332 

(70.3) 


182 

(7.8) 


0 

(0.0) 


0 

(0.0) 


0 

(0.0) 


1,921 

(82.4) 


229 

(9.8) 


0 


238 

(7.2) 


20 

(8.4) 


0 

(0.0) 


0 

(0.0) 


0 

(0.0) 


0 

(0.0) 


218 

(91.6) 


0-4 


3,315 

(100.0) 


260 

(7.8) 


10 

(0.3) 


59 

(1.8) 


536 

(16.2) 


1,989 

(60.0) 


461 

(13.9) 



Notes- Data are based on the SSP applicant sample. The table entries are 

individuals in the sample with each pre- random- assignment lA status and each 
12-month interview status. 

ajhe mii*>ers in parentheses are percentages of the numter of casM for that row 
(i.e., by the nuitoer of lA checks received prior to random assignment). 

bu.„^r of months of post-random-assignment labor market data collected from the 
individual in the 12-month survey. 



o 

ERIC 



44 



- 36 - 



E 

o 



c 

ID 

u 

1 



o 

m 



•8 



^ S 

;i 

o — 

1. (A 
O M 



Si 

u a 

M I- 



Bt 

«> 



l! 



8-i 

s *> 

M ^ 



O 

O 



c/> 

H- 

o «> 
£ 
M 4-» 
C 

ta u 

c> o 



o 

2 



1 



1 



1 



«^l O CO 



I «.»■ 

ro m 



oo (M 

to ^ 

K* "" 
0» 



ro ro 



o 

^ CO 



O fO 

tS5 "" 

CO 



in o 
fvj r- 



o o 

CM CM 



O '•4’ 



ro in N- o 

o 00 ro o 



^ CO 
in o 



CM 

o <y 



ro •- •- m (► N- 



(►in ^ 

!P o r S 



ro 'O 



>0 o *- CM o O 

00 «-> ^ ro CM 

^ CM I CM I CM 



in o r^«- lo ^ 



ro ro CM ^ rw CM 



in ^ CO ^ ro ro in 

5i;£ as feP 

rww 5)w 



in 
oo in 



(► N. ^ 'O 



•- N. O in 
^ in 



>o in o in m ^ 

5^ SC 



c| 

o 

ul 



<) 

in o 
ro 4 - 
<► 



•- ^ 

b foro wji 

r: ffic «C w 55 w 55 w 



•- *- 00 ro •" oo 

oo in €► in 



00 

in in 



^ oo 



^ o ro«- 00 oo 
lA in o ^ p;0 

ac SC sc 



(► ►- 

gsc 



« 00 

oo in 
o •- 



£ 



J\ K,?; -oJ? «c -s «s 2" 

i ?s vi iz -Z ~c -C °c °c ~c ~c ^ 

h\ si 25 :5 ^5 :-5 4 °-§ 

£“?STC?C^C~w 



I srS .rS «;o 0;;o .rS -^5 O; 3 ^ ^ 

I gs iz iz ^z f£c gc sc sc sc sc Sw 

o 



”1 c> oo o o CM <) ro 
2 in o in !>* r. 



-I mo i- = 

4^1 (► w oo w oo 

c 
o, 

(-* 



ro m ’>#■ (► 

— inv- cM^ (►^ 555 

^ ICS fww ^ 



^ ^ ^ ^ ^ 
^ rO'i*' 0*4' *2"^ 

* ^ ^ CM*- 

C sc Sw *o w *o w *o ^ 



01 
X 
1 1’ 



1 



ro oo mi 

do ' 



^ oo mi 

do ’ 



I in CM N. ro oo *0 00 



£ «» 5 «o o. «o o. rj o. « o. « o. 

C °C °C '^C ^C ^C ^C 



^ %o 0*00 0*0* ro 



O* o 

O CM 



m o 

O CM 



o 

4-^ CM 



rw «- 4-^ 

^ CM CM ^ CM 



0*0 CM ^ CM CM *|» 



S 2 = 

1.1 
CL 

J!l| O 

£ 

4-* O ' 

s ^ 



c •- 

ol 

ac 



^ O N. 4- ^ 

(► w OO ’*-' oo ’*-' 



N. m ro O* 4- CM 



4- CM 
w ►» 



kJ 4-S *oC cmC oS m^ ^ 

c Sc sc SC sc Die SC S 



oo 0*0 4-4- *P*“ 

§C S'*-' OO'*-' N.W 



in ro oo 

4-^4-^ 

w *0 



3 m? mm rom om o 

* 1 * eo 4 — ^4- *1^4- "S' 

w 3 '*-' *0 <*-' in '*-' m *«-' mw m 



o 

ERIC 



- 37 - 



45 




CO m O <y 



fA oj 



00 m 

rvj CM 



m N. 



>0 

O CM 



ro « 

O CM 



CM CM CM 



CM in 
ro CM 



•- h- 
CM 



O OO •- CO 

CM ro CM 



o m 
ro CM 



€0 CO 

CM CM 



00 '<0 
CM 



00 

CM 



o o o 



00 O 
O CM 



00 

O CM 



00 O 
CM 



O CM ^ CM ^ CM 



^1 CM OO 



ro OO ro O 



in CM 
ro w 



CM O CM O CO 

r .1 CM 00 CM ^ CM •- 

ro w ro w ro w 



w- m w - 1 



*-* I o» •- 



N. C^ 
in •- 
CM w 



^1 •- «o 



Os N. 

O O 
00 CM 
CM w 



sO •" 
O 



00 in 
Ch ^ 



CM CM 
lO ^ 



ino^ in CM ro w- com <> Osj 



•- o* in »- 'O !Z 

«— CM CM ro ro 



o ^ 

>0 ro 



Nj- CM 1 - •- ^ CM 



Os in CM o> 



S S 

CM W 



00 Os 

o o 



•- o* 

CM •- 



sO.«- 
O CM 

ro s^ 



CM ro 

o ^ 



Os o 

o •- 



r- •- 

CM 



• 4 ’ CM 
ro CM 
lO ^ 



in 

CM •- 



h- o 

^ CM 



ro ro 

^ CM Os CM 

ro w ro w 



<.j* o ro CO 

^ ^ IP 

in CM K. CM 

ro w ro w 



m m 
CM CM 
stf- s-» 



ro sO 

si ?3 



stf’ m 
ro CM 
stf- W 



00 ro 

S fS 



N> «- CM sO 

in ^ o so 

ro ro CM ro 



w— ro m CM CM j 

1 /^ >0 Os m s^ ' 

5 CM >» CM ^ < 

W Xil' ^ s* 



Os Os sO 

o CM CM CM 



O' ® *® 

ro-^ CM«-^ CM*^ 

^ W w Stel» W 



m o Os o 

CM CM CM 



® •" Os •-; CO 

CM CM •- CM O CM 



-^1 sO 



rss. •- 
CM 



s ^ 



^ ^ sO CO 

CM •- •” iO •" 

ro w ro w ro w 



«0 s^ CO CM in 

o ro •- 

ro w ro ro 



^ m 00 m »“ in 

^ ^ sO ^ ?9 ^ 

ro w ro w ro w 



mm o m sO m 

^ sO •- ® •" 

ro ro ro w 



.p. . p M 

M >« V Cj 



01 CD S'- & 

3 3 

M O 
4 .t <p- or ^ 
c > _ o> 



J S.|'-g'8| 



a c 



ts 



•8 



C ® s? Si 

w 3 w 

Q. c ‘J O 

C E 0 ) *0 ^ 
or Lu O CO & 

4-» or or 
or • or f ^ 

CO ^ 4 -* 

or T3 ^ 

' (0 •« c 



4 -< o ^ 
or 3 4-* 3 
u o 3 13 

c _ o -r 



o 

ERIC 



:- 38 - 



46 



ADoendix Table A3; Distribution of Income Assistance (lA) Leaving Tunes a^ 

^ Cunulative Excess Percent of Program Group Members Still on lA 



Nunber of 

months 

since 

entering I A 


Percent Leaving 
in Month 


emulative Excess 
Percent of Program 
Group Still on_JA — 


Controls 


Programs 


Raw Adjusted 


1 


0.5 


1.0 


-0.6 -0.5 


2 


3.7 


4.2 


-1.0 -0.7 


3 


8.3 


8.3 


-1.0 -0.5 


4 


8.8 


7.6 


0.2 0.7 


5 


6.2 


5.5 


0.9 1.4 


6 


5.2 


4.9 


1.3 1.7 


7 


4.7 


4.2 


1.8 2.2 


8 


3.5 


3.5 


1.9 2.3 


9 


2.8 


2.9 


1.8 2.2 


10 


3.2 


2.6 


2.4 2.8* 


11 


2.6 


2.9 


2.2 2.5 


12 


2.3 


1.8 


2.7 3.0* 


13 


1.6 


2.0 


2.2 2.6 


14+ 


46.6 


48.8 


N/A N/A 



Notes: Derived from SSP Applicant File. N/A = not applicable. The 
emulative excess percent of the program group still on I A \s 
the difference between the fractions of the program group and 
control group who have left lA up to and including the current 
month. The adjusted excess percent is derived frm a series 
of linear regression models for the event of remaining on lA 
up to and including the current month. The models include 42 
baseline covariates. 

•Significantly different from 0 at the 10 percent level, 
two'tai led t-test. 
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